Accessory device operation with user mobile device over network connection

ABSTRACT

An accessory device application executes on an accessory device of limited resources. The accessory device application includes an accessory device stub application and an interface definition. When a user interacts with the accessory device application, display changes are generated in response, in accordance with the interface definition, and are sent to a companion extension at an associated companion device. The companion extension receives the changes, and generates updated display values for the accessory device display. The updated display values are sent from the companion device daemon to the daemon of the accessory device, which displays the updated display values at the accessory device display. The functionality and operation of the accessory device application permit an accessory device of limited resources to leverage data processing and computational power of the companion device, to provide a more involving user experience at the accessory device.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application claims the benefit of U.S. ProvisionalApplication No. 62/044,797, filed Sep. 2, 2014, which is herebyincorporated by reference for all purposes.

BACKGROUND

The present disclosure relates generally to wireless electronic devicesand in particular to operating an accessory device with a user mobiledevice.

Many wireless mobile electronic devices, such as wireless telephones,portable music players, tablet computers, and the like are carried aboutas almost a personal companion. It may be desirable for a user toacquire an accessory device that can operate with the mobile electronicdevice. An accessory device may comprise, for example, a wearablecomputer device. A user accessory device typically has reduced resourcesand computing power as compared to most mobile electronic devices.Nevertheless, with an accessory device, users would like to enjoyfeatures associated with many mobile devices, such as installingselected applications for operation on the accessory device. Increasedconvenience and enjoyment by a user may be gained from installation ofapplications and operation of applications from the mobile device.

BRIEF SUMMARY

In accordance with disclosed embodiments, an accessory deviceapplication executes on an accessory device of limited resources. Theaccessory device application includes an accessory device stubapplication and an interface definition that are installed at theaccessory device. When a user interacts with the accessory device,events and user commands are generated in response by the accessorydevice stub application and are provided to an accessory device daemon,in accordance with the interface definition, and are sent to a companionextension at an associated companion device. The companion extensionreceives the events and user commands, and generates updated displayvalues for the accessory device display. The updated display values aresent from the companion device to the daemon of the accessory device,which displays the updated display values at the accessory devicedisplay. The functionality and operation of the accessory deviceapplication permit an accessory device of limited resources to leveragedata processing and computational power of the companion device, toprovide a more involving user experience at the accessory device.

Other embodiments are directed to systems, portable consumer devices,and computer readable media associated with methods described herein.

A better understanding of the nature and advantages of embodiments ofthe present invention may be gained with reference to the followingdetailed description and the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of computer devices according to an embodimentof the invention.

FIG. 2 is a flowchart representation of operations performed by a servercomputer device such as illustrated in FIG. 1.

FIG. 3 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 2.

FIG. 4 is a flowchart representation of operations for installing anapplication package at a mobile computer device such as illustrated inFIG. 1.

FIG. 5 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 4.

FIG. 6 is a flowchart representation of operations for installing anaccessory application file at an accessory computer device such asillustrated in FIG. 1.

FIG. 7 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 6.

FIG. 8 is a flowchart representation of operations for determining theinitial display upon launch of an accessory device such as illustratedin FIG. 1.

FIG. 9 is a flowchart representation of operations for updating thedisplay of an accessory device such as illustrated in FIG. 1.

FIG. 10 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 8 and FIG. 9.

FIG. 11 is a block diagram that illustrates the companion device sendinga notification to the accessory device for the devices illustrated inFIG. 1.

FIGS. 12A and 12B comprise a flowchart representation of operations forprocessing notifications received at the companion device intended fordisplay at an accessory device with a custom user interface, such as atthe devices illustrated in FIG. 11.

FIG. 13 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 12A and FIG. 12B.

FIG. 14 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 12A and FIG. 12B.

FIG. 15 is a block diagram that illustrates the processing of theaccessory device illustrated in FIG. 14.

FIG. 16 is a block diagram of a computer device according to anembodiment of the invention.

DEFINITIONS

As used herein, an accessory device is a class of computer device havinggenerally limited resources and operated with a companion mobilecomputer device. For example, an accessory device may comprise awearable computer device, such as a watch or health signs monitor orsimilar device of reduced size (e.g., any device that can be worn arounda wrist, finger, neck, ear, and the like, or can be otherwise attachedto a person or to the person's clothing). Such accessory computingdevices have limited resources in that they have processors that are ofrelatively lesser capability, or have limited storage capacity, ascompared with, for example, mobile computing devices such as smarttelephones or tablet computers. The limited resources of an accessorycomputing device can result in challenging conditions for installingapplications and providing useful features for a user.

DETAILED DESCRIPTION

In accordance with embodiments, applications for installation on anaccessory computing device are provided as application packages that arereceived by an associated mobile computing device, also referred to as acompanion device. The application package identifies the application foroperation on the accessory device. The requested application package isreceived at the companion device and, pursuant to the operating systemof the companion device, is installed such that the components of theapplication package are automatically extracted. The application packageincludes a companion application, a companion extension, and anaccessory device application file. The accessory device application fileincludes an accessory device stub application and an interfacedefinition. The application package components comprising the companionapplication, companion extension, accessory device stub application, andinterface definition are configured to interoperate in accordance withan application package identifier that is mutually recognized among allthe components and respective communication daemons that are included inthe operating system (OS) of each respective device. In this way, theresources of the mobile computing device are utilized for installing theaccessory computing device application and associated components.

Additional sections of this document discuss techniques in whichnotifications for an accessory device are received at a mobile companiondevice. The notifications are directed to a notification processingapplication of the companion device that processes notificationsintended for accessory device applications. The notification processingapplication determines an identifier of the accessory application forwhich the notification is intended, and provides the identifier to anotification display application at the accessory device, whichdetermines user interface and display properties for the notification.The accessory device requests external (dynamic) user interface anddisplay properties from the companion device, as needed, and uponreceipt generates a notification display at the accessory device.

In accordance with embodiments, an accessory device is operated inconjunction with an accessory device application whose functionalprocessing, storing, and calculating operations are performed by thecompanion device. In this way, the accessory device application executeson an accessory device of limited resources. The accessory deviceapplication includes an accessory device stub application and aninterface definition that are installed at the accessory device. When auser interacts with the accessory device application, events and usercommands are generated in response by the accessory device stubapplication, in accordance with the interface definition, and are sentto the companion extension at the associated companion device. Thecompanion extension receives the events and user commands, and generatesupdated display values for the accessory device display. The updateddisplay values are sent from a daemon of the companion device to acorresponding daemon of the accessory device, which displays the updateddisplay values at the accessory device display. Thus, communicationsbetween the companion device and the accessory device are handled bycorresponding daemons on each device utilizing application names oridentification codes that are mutually recognized for proper routing ofcommunications.

I. Device Configurations

FIG. 1 is a block diagram of multiple computer devices according to anembodiment of the invention. Among the multiple devices 100 incommunication with each other, a computing server device 110communicates with a mobile computing device, also referred to as acompanion device 120. The companion device 120 communicates with anaccessory computing device 130 of relatively limited resources, in termsof computing power and data storage capacity. A package generatingapplication 112 at the server device 110 can receive requests from thirdparty developers for generating an application package intended for anaccessory device, and the package generating application will generatethe associated files. More particularly, a third party can provide theserver device 110 with an accessory application file comprising anaccessory device stub application and an interface definition, and theserver device will automatically generate a companion application and acompanion extension that are configured for interoperation with theaccessory application file. The generated companion application andcompanion extension, along with the accessory device stub applicationand interface definition, are combined to provide an accessory deviceapplication package. That is, the package generating application 112 cancomprise, for example, an application that configures mobile deviceapplications received from developers for sale at an online applicationstore.

At the companion device 120, the application package for the accessorycomputing device 130 is received, and the package components areautomatically extracted from the received application package forinstallation at the accessory device 130. The extracted components areillustrated in FIG. 3 as the accessory application 132. The interfacedefinition of the application package, to be installed at the accessorydevice, defines display values for a display of the accessory device.The stub application of the application package comprises programmingcode, such as a script, that upon execution loads a device framework,which include code to interpret the interface definition and createdisplay interface elements to provide the accessory device applicationfunctionality. These components of the accessory application 132, theinterface definition and the stub application, are described furtherbelow. The companion device extension of the application packageoperates to determine the display values of the interface elements.

In accordance with embodiments, the package generating application 112determines received device applications that are intended for operationat an accessory device, such as submissions that include an appropriateinterface definition, and automatically generates a correspondingapplication package that includes components such as a companion deviceapplication and companion device extension. The application packageidentifies an application for operation on the accessory device, suchthat the application package includes components comprising a companiondevice application, the companion device extension, the accessory devicestub application, and the interface definition. The respective devicedaemons are included with the operating system of their respectivedevice and support communication between the devices, based on amutually known identifier associated with the components in theapplication package, such as the accessory device application name.

The companion device 120 includes a companion device application 122that comprises an installed application package such as described above.More particularly, the companion device 120 receives, for installation,an application package that includes components comprising the companiondevice application, the companion device extension, the accessory devicestub application, and the interface definition. As noted, theapplication package components are configured to operate with a mutuallyknown identifier. When the companion device 120 installs the applicationpackage, the companion device sends an indication to the server device110 that the application package has been installed on the companiondevice, such that the components comprising the accessory device stubapplication and the interface definition have been sent to an accessorydevice 130 for installation. In this way, the installation of thecompanion device application is registered with the server 110.

The double-headed arrows 150, 160 in FIG. 1 indicate network connectionsfor communication between the server device 110 and the companion device120, and between the companion device 120 and the accessory device 130.The connections may comprise a wired network connection, or a wirelessnetwork connection, or a combination of the two types of connection.

The accessory device 130 can be a wearable accessory device, forexample. Wearable accessory devices can be implemented in any wearablearticle. For example, the accessory device 130 can be implemented as orwithin a watch, a bracelet, a necklace, a ring, a belt, a jacket,glasses, goggles, headphones, ear buds, hearing aids, or the like, orcan be placed inside and attached to such articles. The companion device120 and the accessory device 130 can be any kinds of portable electronicdevices, such as a portable music player, a digital camera, a laptopcomputer, a tablet computer, a digital audio recorder, enhanced realitygoggles, headphones, earpieces, or a smart phone, for example. Thedevices 120 and 130 can be the same or different kinds of devices.

II. Producing an Application Package

FIG. 2 shows a flowchart representation of operations performed by theserver computer device 110 with respect to the companion device 120 andaccessory device 130 such as illustrated in FIG. 1 for producing anapplication package. FIG. 3 illustrates the systems and structures 300involved in the FIG. 2 operation, including a third party developer 310,the server computer device 110, the companion device 120, and theaccessory device 130.

In the operation 210 of FIG. 2, the server computer 110 receives anaccessory device stub application 312 and an accessory device interfacedefinition 314. The stub application generates events, commands, anddisplay values through referencing, calling, or executing program codeof a library, or framework, in response to notifications and userinteraction with the device, in accordance with the interface definition314. The stub application 312 may be implemented as, for example, ascript or program call that can be executed by a processor of theaccessory device. The events and commands and display values are sentfrom the accessory device to the companion extension at the associatedcompanion device via respective communication daemons 320, 322 of thedevices. The companion extension receives the events and user commands,and generates updated display values for the accessory device display.In response to receiving the accessory device stub application 312 andinterface definition 314, the server computer 110 generates anapplication package intended for the accessory device 130. The servermay receive, in addition to the accessory device stub application 312and interface definition 314, a request to generate the applicationpackage from the third party developer 310 of the accessory device stubapplication 312 and interface definition 314. The request is not aprerequisite for the server computer to generate the applicationpackage.

The accessory device stub application 312 and interface definition 314comprise an accessory device application file and are intended forstoring at the intended accessory device. The accessory device includesan operating system with an accessory device daemon 320 that manageswireless communications between the accessory device 130 and theassociated companion device 120. The stub application 312 provided bythe third party developer 310 comprises a small amount of code that isexecuted by the accessory device with minimal demand on accessory deviceresources such as processor operations and data storage. The interfacedefinition 314 provided by the third party developer comprises data thatdefines aspects of the user interface that is used by the accessorydevice 130. For example, the data can include data values that are usedto display buttons, text fields, and other user interactive artifacts tobe displayed on a display of the accessory device.

Upon receiving the accessory device stub application 312 and interfacedefinition 314 from the third party developer 310, the server device 110stores them as an accessory device application file 332. The accessorydevice application file includes an identifier, as indicated byidentification data in the accessory device interface definition 314.For example, the identifier may define an accessory device applicationname.

In the operation 212 of FIG. 2, the server device 110 uses its packagegenerating application 112 to generate application code corresponding tothe identified application name. The application code that is generatedincludes a companion application 334 and companion extension 336. Thecompanion application 334 is for execution at the companion device 120in support of the accessory application 312, the companion extension 336is for determining the proper companion application and frameworkelements at the companion device 120 in support of the accessoryapplication.

The application code and the accessory device application file comprisean application package. The application package components of thecompanion application 334, companion extension 336, and accessory deviceapplication file 332 share a common accessory application identifiercomprising the application name or an assigned application number orother suitable indicia by which all the package components can beunderstood by a computing device as being associated with the sameaccessory application. The application package components are configuredto operate with the mutually known application identifier. Theapplication package components comprise multiple files that may beseparately stored, transmitted, and identified in a computerenvironment, but the application package itself is generated as a singlefile that may be stored and transmitted and identified under one filename.

After the application package is generated, at the box 212, theapplication package is available from the server computer 110 fordownload and installation at companion devices. The applicationidentifier can be publicized and made known to users, who may wish toobtain the identified application for installation on their accessorydevice, from their companion device. That is, the application packagemay be marketed and identified as being for an accessory device, but theapplication package with companion device components may be obtainedthrough an online store that caters to companion devices.

In the operation 214, the server device 110 may receive a request forthe application package from a user who wishes to install the accessoryapplication at an accessory device. The request may be, for example, inthe form of a download request from a user through an online store withan application download interface.

At the operation box 216 of FIG. 2, the server device 110 may respond tothe received request for the application package by sending to thecompanion device 120 the identified accessory device application package362.

Upon receiving the accessory device application package 362, thecompanion device 120 automatically extracts the components using itsoperating system. The extracted components include the accessory deviceapplication file 332, the companion application 334, and the companionextension 336. When these components are extracted and installed on thecompanion device, the companion device notifies the server device 110that the application has been received and installed, as is usual forinstallation of a downloaded device application.

In the operation 218, after the accessory device application package 362has been installed at the companion device 120, and once the companiondevice has come into communication with an accessory device 130, thecompanion device may send the components comprising the accessory devicestub application 312 and the interface definition 314 to the accessorydevice 130 for installation. If desired, the accessory device orcompanion device may first inquire of the user if installation isdesired, by a suitable query on the display of the respective device. Anaffirmative response will result in storing the accessory device stubapplication 312 and the interface definition 314 at the accessorydevice, a negative response stops any such storing activity. If storageis desired, at the accessory device 130, the extracted accessory devicestub application 312 and the interface definition 314 are received fromthe companion device 120 and are stored.

The double-headed arrows 340, 350, 370 in FIG. 3 indicate networkconnections for communication between the third party developer 310 andthe server device 110, between the server device and the companiondevice 120, and between the companion device and the accessory device130. The connections may comprise a wired network connection, or awireless network connection, or a combination of the two types ofconnection.

III. Installing the Companion Application

FIG. 4 is a flowchart representation of operations for installing anapplication package at a mobile computer device such as illustrated inFIG. 1. FIG. 5 illustrates the systems and structures 500 involved inthe FIG. 4 operation, including the server computer device 110, thecompanion device 120, and the accessory device 130.

In the FIG. 4 operations of box 402, the companion device 120 receivesan accessory device application package 362 for use with an associatedaccessory device 130. As discussed above, the accessory deviceapplication package components include the accessory device applicationfile 332, the companion application 334, and the companion extension336. When the companion device 120 receives the application file, itautomatically inspects the code contained in the application file 332,according to the operating system of the companion device. Theinspection will reveal to the companion device if the application file332 includes the additional code and data intended for the accessorydevice, such as the accessory device stub application 312 and interfacedefinition 314, by virtue of the application name identifier or similarinformation in the application file. If the verification fails, then thecompanion device can provide a system message to inform the user, and/ornotification and failure processing may commence at the companiondevice.

In the next operation 404, the companion device 120 extracts theaccessory device application package components. The extractingoperation may include a verification or authorization action to validatethe stub application. For example, the companion device may perform acheck for a proper application identifier. The extracting operation, andany verification of the components, may be managed by the operatingsystem of the companion device.

At the operation of box 406, upon verification, the companion device 120installs the accessory device application package 362. The installationmay comprise storing the components at appropriate storage locations ofthe companion device memory. FIG. 5 shows that the components of theaccessory device application package 362 received at the companiondevice 120 include an application file 532, a companion deviceapplication 534, and a companion extension 536. The application file 532also includes an accessory device stub application 312 and an interfacedefinition 314, both of which are stored in the associated accessorydevice 130, as described further below.

At the operation 408, the companion device 120 sends the accessorydevice application file 532 to the accessory device 130 forinstallation. Before the installation operation 408, as part of the box406 operation, the companion device 120 or the accessory device 130 maydisplay an inquiry message to request confirmation of the installationprior to installing the file contents in the accessory device. Theframework data stored in the companion device memory may also be storedin the accessory device, in accordance with the companion deviceoperating system and accessory device operating system. Alternatively,the framework data may be stored in the companion device and called forby the accessory device only when needed. In this way, the accessorydevice may conveniently utilize the resources of the companion devicewithout consuming accessory device resources.

The double-headed arrows 550, 570 in FIG. 5 indicate network connectionsfor communication between the server device 110 and the companion device120, and between the companion device 120 and the accessory device 130.The connections may comprise a wired network connection, or a wirelessnetwork connection, or a combination of the two types of connection.

IV. Installing the Accessory Application File

FIG. 6 is a flowchart representation of operations performed by anaccessory computer device such as illustrated in FIG. 1 for installingthe accessory application. FIG. 7 illustrates the systems and structures700 involved in the FIG. 6 operation, including the companion device 120and the accessory device 130.

At the operation 602, the accessory device receives an accessory deviceapplication file 532 from an associated companion device 120. Asillustrated in FIG. 7 and described above, the accessory deviceapplication file 532 includes the accessory device stub application 312and an interface definition 314 for operating the accessory device in adesired manner. As noted above, the stub application includes programcode comprising, for example, a script that can be executed by aprocessor of the accessory device, while the interface definitionincludes alphanumeric data that defines display artifacts and theirproperties and includes a framework for generating a display screen orwindow for the accessory device. The accessory device application file532 may also be referred to as the “accessory application” that, asnoted, includes the accessory device stub application 312 and theinterface definition 314, and communicates with the accessory devicedaemon 320. The accessory device application file 532, which comprisesan executable file that includes the companion device extension and theaccessory device application with the accessory device stub application,once installed is involved in receiving user events and display databased on the interface definition 314.

In the operation 608, the accessory device 130 installs the accessorydevice stub application 312 and interface definition 314 received fromthe companion device 120. The installation may comprise storing thesecomponents at appropriate locations of accessory device memory. Thestoring to the accessory device may be initiated and implemented bycommand of the associated companion device, or it may be implemented bythe accessory device, as known to those skilled in the art.

In the operation 612, upon installation of the accessory device stubapplication 312 and interface definition 314, the accessory device stubapplication may be automatically launched. As part of the initial launchof the stub application, a message may be sent from the accessory deviceto the companion device 120 to confirm the installation has completed.The companion device will know which accessory device application hasbeen installed, because of the application name identifier that iscommon among the components of the application package discussed above.The companion device may, in turn, register the confirmation ofaccessory application installation to the server computer 110. At box612, once the accessory device stub application 312 is launched, itreads the interface definition.

As noted above, the respective daemons 320, 322 of the devices 130, 120may handle communications (i.e., route messages) for multipleapplications. The application identifier is used by the daemons to routemessages to the intended and appropriate application among the multipleapplications that might be installed on the devices. For example, if thecompanion device includes a second application, illustrated in FIG. 7 asthe Companion Application B 702, the companion device daemon 322 willreceive application messages and will route the application messages tothe appropriate application, such as either the companion deviceapplication 534 or Companion Application B 702, in accordance with theapplication identifier that is contained in the respective applicationmessages. Thus, the solitary companion device daemon 322 may routemessages for multiple applications installed at the companion device120. The companion device daemon 322 is typically included in the OS,but is not typically enabled until an accessory device is paired withthe companion device, via launching an accessory device application 532.A similar operation may hold for the accessory device 130. For example,if the accessory device 130 includes a second application, illustratedin FIG. 7 as the Accessory Device Application File B 710, then theaccessory device daemon 320, which is included in the accessory deviceOS, will properly route messages, using the application identifier.

The double-headed arrows 770 in FIG. 7 indicate network connections forcommunication between the companion device 120 and the accessory device130. The connections may comprise a wired network connection, or awireless network connection, or a combination of the two types ofconnection. The various components described above communicate, asnoted, over these network connections. That is, the companion deviceapplication 534 contains the companion extension 536 and the accessoryapplication 532, with the accessory device stub application 312 and theinterface definition 314, and is installed via the server device 110 andcompanion device 120 but is not directly involved during execution ofthe companion application. The companion extension 536 communicates withthe companion device daemon 322 and is involved in generating data todisplay at the accessory device and in responding to user events. Thecompanion extension 536 is typically supplied by a third party andcontains code supplied by the third party for the operation of thecompanion extension. The companion device daemon 322 communicates withthe accessory device daemon 320 and manages the installation of theaccessory device application 532, starting the companion extension 536on request from the accessory device daemon 320, and communicates withthe companion extension 536. The companion device daemon 322 istypically included in the companion device 120 as native (installed)code. The accessory device daemon 320 communicates with the accessorydevice application 532 and with the companion device daemon 322, and istypically included in the accessory device 130 as native (installed)code.

V. Updating the Display of the Accessory Device

FIG. 8 is a flowchart representation of operations for updating thedisplay of an accessory device such as illustrated in FIG. 1, for alaunch display. FIG. 9 is a flowchart representation of operations forupdating the display of an accessory device such as illustrated in FIG.1, after a launch. FIG. 10 is a block diagram that illustrates thedevices that perform the operations illustrated in FIG. 8 and FIG. 9.

The companion device application 534 (FIG. 10) may receive informationmessages and notifications from the companion extension 536. Some of thereceived messages and notifications may be intended for the accessorydevice. The received messages and notifications may comprise systemalerts, warnings, acknowledgements, and other system-generated messages.The received messages and notifications may be prepared by the companionextension for display at the accessory device or for display at thecompanion device, or both, as determined by programming of the companiondevice application 534.

The companion extension 536 includes programming code that, whenexecuted by the companion device 120, determines display values fordisplay at the accessory device 130. The companion extension 536determines the display values in accordance with framework data that isstored in the companion device, which the extension automaticallyaccesses through an operating system of the companion device. Theframework data may be supplied by the developer of the application file,or may be supplied by a server or other source of information, or maycomprise framework elements that are included with the operating systemof the companion device, or may comprise a combination of componentsfrom such sources. The application framework data accessed by theextension defines display artifacts such as, for example, displaybuttons, windows, text boxes, backgrounds, wallpaper, and the like.

The companion device daemon 538 includes programming code that, whenexecuted by the processor of the companion device 130, provides aninterface for communication between the companion device application andthe accessory device application. That is, the companion device daemonreceives messages from the accessory device daemon and passes thereceived messages to appropriate components of the companion device, andalso receives data intended for the accessory device from components ofthe companion device, and prepares corresponding messages that includethe data for sending to the accessory device 130.

In the operation 802, the installed accessory application has beenlaunched, either by the user or by the accessory device upon initialinstallation of the accessory device application file. Moreparticularly, the accessory application is automatically launched afterthe installation of the accessory device application file at theaccessory device is complete and the accessory device stub application312 and interface definition 314 are installed and ready for operation,as discussed above in Section IV.

As noted above, the accessory device application launch comprisesexecution of the accessory device stub application 312, so that theframework of display artifacts and associated application data isaccessed, as needed, at the accessory device. The accessory deviceinterface definition 314 may be accessed, as well. At the box 804,communication is established between the accessory device application312 and the accessory device daemon 320. Thus, launching the accessoryapplication executes the accessory device stub application 312 andaccesses the associated framework and interface definition 314. Theaccessory device stub application may also perform code checking andauthorization tasks. That is, the accessory device stub application mayvalidate the received application file by examining code information inthe file, and such information may be hashed, signed, and validated. Inthis way, the application file and associated information may bevalidated at each launch of the accessory device application.

At the box 806, launching the accessory device stub application 312causes the accessory device daemon 320 to establish communication withthe companion device daemon 538. The accessory device daemon willprovide the accessory application identifier described above to thecompanion daemon, thus ensuring that the data values and othercommunications from the accessory device will be directed to the propercompanion application by the companion daemon. The accessory devicedaemon 320 will also provide the companion device 120 with displayvalues and other information necessary for the companion device todetermine display values for the accessory device display.

In the operation of the box 810, the companion device daemon 538 causesthe companion extension 536 to be launched, in response to establishmentof communication with the accessory device 130. This begins theprocessing at the companion device for determining display values forthe initial display at the accessory device.

In the operation 814, initial display values are determined. Thecompanion device application 534 and companion extension 536 can utilizethe resources of the companion device 120 to determine the initialdisplay values, based on the information received from the accessorydevice through the companion daemon 538 and the framework data stored inthe companion device as part of the companion operating system and/orthe installation of the accessory device package.

At the box 818, the determined initial display values are sent from thecompanion device 120 to the accessory device 130. More particularly, thecompanion application 534 and companion extension 536 determine thedisplay values and then pass the display values along to the companiondevice daemon. The initial display values are sent from the companiondaemon to the accessory device daemon.

At the box 822, the accessory device daemon 320 receives the initialdisplay values and causes a corresponding display screen to be generatedat the accessory device 130 in accordance with the interface definition314. The accessory device may format the received values to a displaymessage suitable for the accessory display interface 1010 to generate anappropriate display. The initial display values are used by theaccessory device stub application 312, in accordance with the displayspecifications of the interface definition 314, to generate the displayartifacts for showing on the accessory device display. For example, anapplication screen or window of the accessory device display may includea variety of display elements that may or may not be grouped, which maycomprise buttons, text boxes, windows, links, and the like. Such displayelements may be either fixed artifacts, or elements that are changed oradjusted on-the-fly, during execution of the application. The interfacedefinition may specify, for example, display buttons and their titles,locations, size, color, and number. The companion application and/orextension can be responsible for changing such properties, in accordancewith information received from the accessory device, and in accordancewith the accessory application identifier. Thus, the companion deviceapplication and/or extension may generate initial display values andprovide them to the accessory device. The interface definition of theaccessory device ensures that the updated values will be properlydisplayed, in accordance with the stub application and interfacedefinition data, and the accessory application identifier.

During normal operation of the accessory device 130, after initiallaunch, the companion device 120 continues to receive notifications andmessages, and continues to determine display values for the accessorydevice. For the initial launch as described above for FIG. 8, thecompanion device may respond to notifications and messages initiated bythe companion device operating system. After the initial launch, thecompanion device may generate updated display values in response toreceived notifications and messages, which may be produced and deliveredto the companion device in response to user interaction at the accessorydevice or, or may be produced in response to system-generated ordevice-generated messages. Such updated display values may result indisplay changes at the accessory device. The handling of theseafter-launch display changes is illustrated in FIG. 9.

In the operation of box 902, a display change at the accessory device130, due to a user interaction or an update notification or message, isdetected by the accessory device stub application 312 at the accessorydevice. The display change may comprise changed display values orproperties from the display interface 1010 in response to a userinteraction with the display of the accessory device, or may comprise anactivation or change in a sensor value, or some other circumstance thatcauses the display values at the accessory device to be changed.

At the box 906, the accessory device stub application 312 generates adisplay message in response to the display change, in accordance withthe interface definition and accessory application. The accessory devicestub application 312 may also determine the accessory applicationidentifier, as described above. More particularly, when the accessorydevice stub application 312 is launched, the framework of displayartifacts and associated application data is accessed by the stubapplication. The information accessed by the accessory device stubapplication permits the stub application to generate the proper displaydata, which is provided to the accessory device daemon 320.

In the operation 910, the generated data received at the accessorydevice daemon 320 is packaged into a data message, with applicationidentifier, and is sent from the accessory device daemon to thecompanion device daemon 322.

In the operation 914, the data message is received at the companiondevice daemon 322 and is provided by the companion daemon to thecompanion device application 534 and companion extension 536, inaccordance with the application identifier. The companion applicationand companion extension determine updated display values in response tothe received data message. The updated display values are provided tothe companion daemon for transport over the network to the accessorydevice.

At the box 918, the updated display values are sent by the companiondevice daemon 322 to the accessory device daemon 320. The companiondevice daemon knows the destination accessory device daemon because ofthe application identifier received in the incoming data message.

At the box 922, the accessory device daemon 320 receives the updateddisplay values from the companion daemon 322. The updated display valuescan be passed to the accessory device interface definition, and data fordisplay by the display interface 1010 is generated accordingly. The datais generated in accordance with processing determined by the developerof the accessory application 132 that is installed at the accessorydevice 130. As noted above, the accessory application 132 includes anaccessory device stub application 312 and an accessory device interfacedefinition 314. The display data may define a change, for example,arising from user interaction with the accessory display, such as abutton press, or arising from a system notification or message, such asan alert. The accessory device daemon utilizes the applicationidentifier of the accessory application in processing the displaymessage.

More particularly, the updated display values are used by the accessorydevice stub application, along with the interface definition, inaccordance with the display specifications of the interface definition,to generate the display artifacts for showing on the accessory devicedisplay. For example, an application screen or window of the accessorydevice display may include a variety of display elements that may or maynot be grouped, which may comprise buttons, text boxes, windows, links,and the like. Such display elements may be either fixed artifacts, orelements that are changed or adjusted on-the-fly, during execution ofthe application. The interface definition may specify, for example,display buttons and their titles, locations, size, color, and number.The companion application and/or extension can be responsible forchanging such properties, in accordance with information received fromthe accessory device, and in accordance with the accessory applicationidentifier. Thus, the companion device application and/or extension maygenerate updated display values and provide them to the accessorydevice. The interface definition of the accessory device ensures thatthe updated values will be properly displayed, in accordance with thestub and interface definition data, and the accessory applicationidentifier.

Thus, the updated display values are calculated at the companion devicein accordance with data passed to the companion device through theaccessory device daemon and companion device daemon. The calculatedupdated display values are passed from the companion daemon back to theaccessory device daemon, where the display changes are used by thedisplay interface 1010 to produce the appropriate display. In this way,the accessory device may conveniently utilize the resources of thecompanion device to update its display.

VI. Notifications at the Accessory Device with Custom User Interfaces

FIG. 11 is a block diagram of the FIG. 1 system 100 that illustrates thecompanion device 120 receiving a notification 1101 intended for theaccessory device 130. The companion device 120 may, from time to time,receive notifications (also referred to as bulletins) that are intendedfor an application 132 installed at the accessory device 130, whether ornot the accessory application is being executed (run). Some of thenotifications may be intended for a class of accessory applications thatmay provide a custom user interface appearance. Such notifications areprocessed according to the following description.

The notification 1101 can be sent via network connections forcommunication between the source of the notification (represented as theserver device 110) and the companion device 120. Notificationinformation including a notification identifier 1150 and an applicationidentifier 1155 from the notification 1101 are retrieved to identify theaccessory application for which the notification is intended. Thenotification ID 1150 and application ID 1155 are directed to theappropriate accessory device application. The accessory device 130determines user interface and display properties for the notification,and sends a request 1160 for external (dynamic) user interface anddisplay properties from the companion device, as needed for display ofthe notification at the accessory device. The content 1170 that isreceived back from the companion device is combined with thenotification ID 1150 and application ID 1155, and a notification displayis generated at the accessory device 130.

FIGS. 12A and 12B comprise a flowchart representation of operations forprocessing notifications received at the companion device intended fordisplay at an accessory device with a custom user interface, such as atthe devices illustrated in FIG. 1. Certain operations are performed bythe companion device and certain operations are performed by theaccessory device. Operations by either device can vary.

At box 1202, a notification is received at a companion device. Thenotification is intended for display on an associated accessory devicethat is in communication with the companion device over a wirelessnetwork connection. The accessory application may, or may not be,executing at the time the notification is received at the companiondevice. After processing, the notification is displayed on the accessorydevice in accordance with a notification interface that is specified bythe developer of the accessory application, as described further below.The notification is received at a message handling daemon of thecompanion device for appropriate distribution.

In the operation of the box 1204, the notification is sent from themessage daemon to a notification processing application, such as aBulletin Board application (“BB application”) of the companion device.The BB application processes the notification to ensure that it isproperly examined and its contents properly directed for handling. Thenotification includes multiple data fields, including a data field thatcontains a notification identifier (e.g., which can be a unique ID) ofthe particular notification, and a data field that contains context datafor the notification. The context data is stored in memory of thecompanion device for late retrieval and for directing the distributionof the notification, as described further below. Thus, after receiving anotification at a message handling daemon of the companion device,wherein the notification is intended for an accessory application at anaccessory device, the daemon directs the received notification to thecompanion device BB application, which determines the notification ID ofthe notification. The BB application can be any application that isconfigured to receive notifications intended for the accessory device.In one implementation, the BB application can also receive notificationsthat are intended for the companion device.

At the box 1206, a companion application daemon gets notification of thereceived notification bulletin from the BB application. The companionapplication daemon performs external processing upon request, asdescribed further below. Therefore, the companion application daemon isinformed of the received notification, even though at this stage of thenotification processing, it is not necessary for the companionapplication daemon to take action.

In the operation at the box 1208, the BB application determines whichaccessory application gets the notification for processing. The BBapplication may determine the application using an Accessory ApplicationIdentifier (App ID) for an application at the accessory device. The AppID is contained in a data field of the notification, and is retrieved bythe BB application. That is, the BB application is configured torecognize the App ID data in the notification, as well as other data, asdescribed further below. The BB application may have its own daemon forID determination processing of this kind. Thus, the App ID determinesthe accessory application for which the notification is intended. TheApp ID is stored in the companion device by the BB application, fordelivery to other processing components of the companion device andaccessory device, as requested. For example, the accessory deviceutilizes the App ID to determine if the application for which thenotification is intended is a third-party application with a custom userinterface display, or is a system application with a predetermined userinterface configuration. A system application may comprise, for example,a mail application or text messaging application. A third-partyapplication may comprise, for example, an application associated with anonline auction service or with a social messaging platform. The App IDof the notification has the same ID value for all notifications intendedfor the same accessory application, and therefore is easily recognizedby the companion device, and is passed to the accessory device.

At the box 1210, a forwarding application on the accessory device isprovided with the notification ID of the notification and the accessoryapplication identifier. This identifying data is received by theforwarding application of the accessory device from the BB applicationof the companion device. The forwarding application, also referred toherein as a carousel application, can be an application that manages ahome screen, launches applications, and/or manages other services. Theforwarding application determines a notification display application,executing on the accessory device, in accordance with the determinedaccessory application identifier, such that the determined notificationdisplay application is configured to process notifications intended forany one of a plurality of accessory applications. The notificationdisplay application is referred to herein as a bulletin factoryapplication. The carousel application forwards the notificationinformation to the bulletin factory application that it has determinedis appropriate for notification handling. The determined bulletinfactory application determines user interface and display properties forgenerating a display of the received notification at the accessorydevice, in accordance with a single indicated accessory application ofthe plurality of accessory applications. Thus, the carousel applicationdetermines the appropriate bulletin factory application for furtherprocessing of the notification and provides that application with thenotification information. In some implementations, the forwardingapplication can be similar to the “Springboard” application in the “iOS”operating system available from Apple Inc. of Cupertino, Calif., USA.Another example of an application that may perform operations such asthose of the forwarding application may include an application such asthe “Launchpad” application that is available with the “Macintosh”operating system from Apple Inc. of Cupertino, Calif., USA. Theoperation processes continues with the operations illustrated in FIG.12B.

At the box 1222, in FIG. 12B, the bulletin factory application loads anotification interface for display of custom notification features forthe received notification. The notification interface specifiesinterface data, in accordance with the unique identification data andcontext data of the notification, that specifies the appearance of thenotification when displayed on the accessory device. Some of theinterface data may be external to the accessory device and will need tobe retrieved, and therefore the companion application provides theretrieved interface data to the accessory device for processing by thedetermined bulletin factory application.

Thus, the operation of processing a received notification at thecompanion device eventually results in the bulletin factory applicationof the accessory device generating a notification interface preferencelist that is used by the bulletin factory application to initiatecommunication with the appropriate corresponding accessory deviceapplication (also referred to as the accessory device “stub” applicationabove) and the corresponding accessory device application daemon. Theaccessory device application daemon communicates with the bulletinfactory application regarding the notification ID.

To be able to contact the companion device to get all the specificinformation that for display of the notification, the companionapplication daemon will communicate with the companion applicationextension, which examines the context data to retrieve any informationneeded from external sources for display of the notification at theaccessory device. The retrieved information may then be provided to theaccessory device application, which then communicates with the bulletinfactory application. In this way, the accessory device application canprovide templates for the notification display at the accessory device,which can then be used to generate the desired notification display withthe bulletin factory application.

In the operation of the box 1224, the accessory application determinesuser interface and display properties for generating a display of thenotification at the accessory device. The accessory application providesthe determined user interface and display properties to the accessoryapplication daemon.

At the box 1226, the accessory application daemon requests content fromthe companion application daemon, in accordance with the notification IDand context data. The context data may comprise a relatively largeamount of data, and therefore the companion application typically doesnot provide the entire details of the context data to the accessorydevice, which would involve a lengthy network communication. Instead,the companion application provides a reduced amount of the context datathat is sufficient for the accessory device to determine the extent ofexternal information it needs to display the notification. For example,the request for content including reduced context data may be determinedby the accessory application in accordance with a notification interfacepreference list (p-list) stored in the accessory device for eachapplication, as described further below.

More particularly, the notification may require external components suchas images or display legends or the like that will be retrieved from anexternal source, such as a Web site or a third party applicationdeveloper. The accessory device has insufficient resources to obtainsuch external data on its own, but instead it will request such externalcomponents from the companion device. Thus, the companion application isconfigured to provide the accessory device with a reduced amount ofinformation from the context data, an amount that is sufficient for theaccessory device to determine whether it will request externalcomponents from the companion device. Thus, the accessory applicationcan use the reduced amount of context data it receives to request theneeded data from the companion application daemon. The companionapplication is configured to recognize, from the accessory devicerequest, where to obtain the external components.

At the box 1228, in response to the request from the accessoryapplication for the content needed for display of the notification, thecompanion application has obtained the requested external components andsends the requested external data components to the accessoryapplication daemon. It may be necessary for the companion application toobtain the requested content from network sources, such as data storedat network storage locations or Web sites. Alternatively, the requestedexternal components might be stored at the companion device itself. Thecompanion application, being installed at the companion device, hassufficient resources at its disposal to obtain such content from networksources and/or its own local storage.

In the box 1230, the accessory application daemon provides the contentto the accessory application for generating display of the notificationat the accessory device. In this way, the obtained content may becombined with the user interface and display properties by the accessoryapplication to properly provide the notification display at theaccessory device. More particularly, the bulletin factory applicationcan determine a display template comprising a base notificationinterface by reading data from a notification preference list stored atthe accessory device. The bulletin factory communicates with theaccessory application daemon, which in turn contacts the companiondevice application daemon to obtain any needed content or externaldisplay components, based on the notification ID and context data. Whenthe bulletin factory application has received content and/or anyexternal display components, it combines the content and/or externaldisplay components with the notification display template, and generatesthe notification display for the accessory device.

A. Categories

The received notification (see box 1204 of FIG. 12A) may include atleast one category. That is, the notification that is sent to thedetermined bulletin factory application may be such that the determinedbulletin factory application generates the display of the receivednotification at the accessory device in accordance with the category, aswell as the retrieved interface data and the determined user interfaceand display properties. Data relating to the optional categories isstored in the context data of the notification, as part of a“categories” data field. Thus, a notification can have a “category” toprovide a parameter to specify multiple notification interfaces for asingle accessory application. In this way, multiple notificationinterfaces (displays) may be accommodated by the notificationcategories. For example, in the case of a social messaging accessoryapplication, there might be multiple types of notifications, such as“liking” a post, or requesting to “friend” another user. Each of thesetypes of notifications can require a different interface, though bothare related to the same accessory application. The category optionprovides a means of designating different custom user interfaces for thesame accessory application. In this way, the social messaging accessoryapplication could include a notification interface category for “liking”a post and could include a different notification interface category fora “friend” request.

The multiple categories can be implemented in one embodiment with, forexample, different interface preference lists for display properties,for each different category that is a possibility in the notification.Thus, the notification interface preference list may include an entrycalled “categories” in which the interface category may be specified.The implementation of the category feature may be made easier byproviding at least one category named “default” in the category datafield, to accommodate the case where an accessory application does nothave multiple categories. More particularly, the category informationmay be provided by the companion application to an accessory deviceapplication daemon, which provides the category to the determinedbulletin factory application.

B. Custom URL

A notification has the capability of launching an accessory applicationand activating a desired operation in the application or initiatingoperation to a predetermined location of the application. For example, anotification may launch an accessory application for social messagingand solicit a “friend” designation for a user identified in thenotification, or may request a “like” response to a URL page identifiedin the notification. Such specific operations of an application arealternatives to a more general notification display, in which a moregeneral specification of a display template may be implemented with anotification interface preference list, in conjunction with notificationdata. For example, a notification interface preference list for anaccessory application may specify an arrangement of display buttons andimages, with display legends or titles provided by information in thenotification data. The notification interface preference list for anaccessory application is typically installed with the installation ofthe application itself at the accessory device.

With respect to processing a notification to launch an application andproceed to a predetermined application location, the operation describedherein utilizes a custom URL (uniform resource locator) that specifies aURL associated with the accessory application and specifies a parameterthat can be utilized by an application or online processing associatedwith the application. For example, a custom URL may include a referenceto a third party social messaging application or an online auctionapplication, and may also include a parameter that can be consumed bythe third party application to perform an application function such assoliciting a “friend” designation for a user identified in thenotification, or requesting a “like” response to a URL page identifiedin the notification.

An example of the custom URL format could include a “com” identifier toindicate a custom URL will follow, and then the format might include anidentifier of the accessory application name, followed by an inputparameter that will be recognized by the accessory application and cansupport communication with the third party application in accordancewith the input parameter. For example, a custom URL may be in the formatof “com.app_name://input_parameter”. The “app_name” is the name of theaccessory application, typically in terms of an online domain nameassociated with the accessory application. The “input_parameter” is theinput parameter that will be recognized by the accessory application tosupport communication with the third party application in accordancewith the input parameter.

If the custom URL processing feature is desired for an accessoryapplication, the preference list for that accessory application willinclude data that the accessory device operating system will recognizeas indicating an ability to process the custom URL. The preference listfor an accessory application is installed at the time the accessoryapplication itself is installed on the device. The accessory applicationwill be configured to correctly process the data contained in the customURL so as to launch the accessory application and proceed to the desiredpredetermined operation or accessory application location. Thus, asdescribed above in this section, the disclosed configuration can providea customized data payload to the companion extension on launch, afterselecting a notification.

C. Operation within Companion Device and Accessory Device

FIG. 13 shows a block diagram that illustrates the devices that performthe operations illustrated in FIG. 12A and FIG. 12B. In FIG. 13, drawingreference numerals for like components have like numerals, with respectto the drawing figures described above.

FIG. 13 illustrates the companion device 120 includes the Bulletin Boardapplication 1320 described above that receives notifications forprocessing. The Bulletin Board application receives notifications and,as described above, directs the received notification to the appropriateaccessory application of the accessory device 130. The other illustratedcomponents of the companion device 120 correspond to the componentsdescribed above, as noted, such as the companion device application 534,companion extension 536, companion device daemon 538, and companiondevice application 122.

FIG. 13 also illustrates the accessory device 130 with its carouselapplication 1330 that, as noted above, determines the appropriatebulletin factory application 1332, which is configured to processnotifications intended for any one of a plurality of accessory deviceapplications. FIG. 13 also shows the notification interface preferencelist 1334, which is used to ensure proper combining of display elementsand templates for display of the notification, and also shows theaccessory device application daemon 1336, which communicates with thebulletin factory application 1332. The double-headed arrows 1160 in FIG.13 indicate network connections for communication between the companiondevice 120 and the accessory device 130. The connections may comprise awired network connection, or a wireless connection, or a combination ofthe two types of connection.

FIG. 14 is a block diagram that illustrates the devices that perform theoperations illustrated in FIG. 12A and FIG. 12B. The bulletin boardapplication 1320 of the companion device 120 receives all incomingnotifications. The bulletin board application provides the accessoryapplication ID and notification data (including the notification ID) tothe companion application daemon 1422, after determining the applicationID and appropriate notification data as described above. Thenotification data may include context data, which is stored in memory ofthe companion device and is used in directing the distribution andhandling of the notification. A companion device applicationnotification extension 1420 receives the information from the companionapplication daemon 1422 and processes the notification for handling, incooperation with the accessory device 130, as described above.

At the accessory device 130, the carousel application 1330 receivesnotification data from the companion device over the network connection1160. The carousel application determines the proper bulletin factoryapplication for handling the notification, in conjunction with thenotification interface preference list 1334 (FIG. 13), and providesnotification data to the determined bulletin factory application. Thebulletin factory application provides notification information,including the notification interface display information, to theaccessory device application 1338 for further processing. The bulletinfactory application may be implemented as a component of, or subset to,the accessory device application. The accessory device application 1338generates the display information for showing the notification at theaccessory device display.

FIG. 15 is a block diagram that illustrates details of the processing ofthe accessory device 130 illustrated in FIG. 14. The carouselapplication 1330 receives notification data from the companion device,as noted above. The carousel application determines the appropriatebulletin factory application 1332 to receive the notification data,based on the accessory application ID of the notification. For example,the accessory device will typically have a mail bulletin factoryassociated with processing notifications for the Mail application.Similarly, most accessory devices will include an SMS application forprocessing text messaging, and the accessory device will include an SMSbulletin factory associated with processing notifications for the SMSapplication.

The bulletin factory application 1332 provides the interface preferencelist (p-list) to the accessory device application 1338 foridentification of processing options, such as custom URL processing, asdescribed above. The bulletin factory application also provides thenotification interface p-list to the accessory device application for atemplate from which the notification display at the accessory device canbe prepared, as described above. The category and context informationcan also be passed from the bulletin factory application to theaccessory device application.

The accessory device application daemon 1336 manages communicationsbetween the accessory device application 1338 and the various componentsof the companion device. For example, the application daemon 1336 mayutilize the notification data as described above in determining externaldata that should be requested from the companion device for display ofthe notification. The application daemon 1336 also can pass the receivedexternal data from the companion device to the accessory deviceapplication for further processing.

VII. Computer Device Configurations

FIG. 16 is a block diagram of a computer device 1600 according to anembodiment of the invention. The computer device 1600 may comprise anyof the devices illustrated in FIG. 1, although those skilled in the artwill understand that some components of the device 1600 may not beincluded, depending on the nature of the device. For example, if thecomputer device is a desktop computer or accessory device, it might notinclude the GPS unit, as movement is not likely in the case of a desktopcomputer, and the limited repertoire of resources on an accessory devicewould not likely include a GPS unit.

The computer device 1600 generally includes a computer-readable medium1602, a processing system 1604, an Input/Output (I/O) subsystem 1606,wireless circuitry 1608, and audio circuitry 1610 including a speaker1650 and a microphone 1652. These components may be coupled by one ormore communication buses or signal lines 1613. The device 1600 can beany electronic computer device, including a wearable computer device, ahandheld computer, a tablet computer, a mobile phone, laptop computer,tablet device, media player, personal digital assistant (PDA), a keyfob, a car key, an access card, a multi-function device, a mobile phone,a portable gaming device, or the like, including a combination of two ormore of these items. As examples, a wearable device can comprise a wristworn device, a device that is clipped or pinned to the user's clothing,a device with a lanyard or chain that is wearable around the user'sneck, a headband device, eyeglasses, or any other device that can besecured to the user's person or clothing.

It should be apparent that the architecture shown in FIG. 16 is only oneexample of an architecture for the computer device 1600, and that thedevice 1600 can have more or fewer components than shown, or a differentconfiguration of components. The various components shown in FIG. 16 canbe implemented in hardware, software, or a combination of both hardwareand software, including one or more signal processing and/or applicationspecific integrated circuits.

Wireless circuitry 1608 is used to send and receive information over awireless link or network to one or more other devices' conventionalcircuitry such as an antenna system, an RF transceiver, one or moreamplifiers, a tuner, one or more oscillators, a digital signalprocessor, a CODEC chipset, memory, and the like. In some embodiments,the wireless circuitry 1608 is capable of establishing and maintainingcommunications with other devices using one or more communicationprotocols, including time division multiple access (TDMA), code divisionmultiple access (CDMA), global system for mobile communications (GSM),Enhanced Data GSM Environment (EDGE), wideband code division multipleaccess (W-CDMA), Long Term Evolution (LTE), LTE-Advanced, WiFi (such asIEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n),Bluetooth, Wi-MAX, voice over Internet Protocol (VoIP), near fieldcommunication protocol (NFC), a protocol for email, instant messaging,and/or a short message service (SMS), or any other suitablecommunication protocol, including communication protocols not yetdeveloped as of the filing date of this document. A computer device caninclude wireless circuitry that can communicate over several differenttypes of wireless networks depending on the range required for thecommunication. For example, a short-range wireless transceiver (e.g.,Bluetooth), a medium-range wireless transceiver (e.g., WiFi), and/or along range wireless transceiver (e.g., GSM/GPRS, UMTS, CDMA2000 1×/EV-DOand LTE/LTE-Advanced) can be used depending on the type of communicationor the range of the communication.

The wireless circuitry 1608 is coupled to the processing system 1604 viaa peripherals interface 1616. The peripherals interface 1616 can includeconventional components for establishing and maintaining communicationbetween peripherals and the processing system 1604. Voice and datainformation received by the wireless circuitry 1608 (e.g., in speechrecognition or voice command applications) is sent to one or moreprocessors 1618 via the peripherals interface 1616. One or moreprocessors 1618 are configurable to process various data formats for oneor more application programs 1634 stored on the medium 1602.

The peripherals interface 1616 couples the input and output peripheralsof the device to a processor 1618 and the computer-readable medium 1602.One or more processors 1618 communicate with the computer-readablemedium 1602 via a controller 1620. The computer-readable medium 1602 canbe any device or medium that can store code and/or data for use by oneor more processors 1618. The medium 1602 can include a memory hierarchy,including cache, main memory and secondary memory. The memory hierarchycan be implemented using any combination of RAM (e.g., SRAM, DRAM,DDRAM), ROM, FLASH, magnetic and/or optical storage devices, such asdisk drives, magnetic tape, CDs (compact discs) and DVDs (digital videodiscs). In some embodiments, the peripherals interface 1616, one or moreprocessors 1618, and the memory controller 1620 can be implemented on asingle chip, such as processing system 1604. In some other embodiments,they can be implemented on separate chips.

The computer device 1600 also includes a power system 1642 for poweringthe various hardware components. The power system 1642 can include apower management system, one or more power sources (e.g., battery,alternating current (AC)), a recharging system, a power failuredetection circuit, a power converter or inverter, a power statusindicator (e.g., a light emitting diode (LED)) and any other componentstypically associated with the generation, management and distribution ofpower in mobile devices.

In some embodiments, the computer device 1600 includes a camera 1644. Insome embodiments, the computer device 1600 includes sensors 1646. Thesensors can include accelerometers, compass, gyrometer, pressuresensors, audio sensors, light sensors, barometers, and the like. Thesensors 1646 can be used to sense location aspects, such as auditory orlight signatures of a location.

In some embodiments, the computer device 1600 can include a GPSreceiver, sometimes referred to as a GPS unit 1648. A computer devicecan use a satellite navigation system, such as the Global PositioningSystem (GPS), to obtain position information, timing information,altitude, or other navigation information. During operation, the GPSunit can receive signals from GPS satellites orbiting the Earth. The GPSunit analyzes the signals to make a transit time and distanceestimation. The GPS unit can determine the current position (currentlocation) of the device. Based on these estimations, the device candetermine a location fix, altitude, and/or current speed. A location fixcan be geographical coordinates such as latitudinal and longitudinalinformation.

One or more processors 1618 run various software components stored inthe medium 1602 to perform various functions for the device 1600. Insome embodiments, the software components include an operating system1622, a communication module (or set of instructions) 1624, a locationmodule (or set of instructions) 1626, a playback app 1628, and otherapplications (or sets of instructions) 1634, such as a navigation app.

The operating system 1622 can be any suitable operating system,including iOS, Mac OS, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or anembedded operating system such as VxWorks. The operating system caninclude various procedures, sets of instructions, software componentsand/or drivers for controlling and managing general system tasks (e.g.,memory management, storage device control, power management, etc.) andfacilitates communication between various hardware and softwarecomponents.

The communication module 1624 facilitates communication with otherdevices over one or more external ports 1636 or via the wirelesscircuitry 1608 and includes various software components for handlingdata received from the wireless circuitry 1608 and/or external port1636. The external port 1636 (e.g., USB, FireWire, Lightning connector,30-pin connector, etc.) is adapted for coupling directly to otherdevices or indirectly over a network (e.g., the Internet, wireless LAN,etc.).

The one or more applications 1634 on the computer device 1600 caninclude any applications installed on the device, including withoutlimitation, a browser, address book, contact list, email, instantmessaging, word processing, keyboard emulation, widgets, JAVA-enabledapplications, encryption, digital rights management, voice recognition,voice replication, a music player (which plays back recorded musicstored in one or more files, such as MP3 or AAC files), and the like.The one or more applications 1634 can also include a specific app forcontrolling playback of content items, updating the content itemdatabase, or any other suitable application.

There may be other modules or sets of instructions (not shown), such asa graphics module, a time module, and the like. For example, thegraphics module can include various conventional software components forrendering, animating and displaying graphical objects (including withoutlimitation text, web pages, icons, digital images, animations and thelike) on a display surface. In another example, a timer module can be asoftware timer. The timer module can also be implemented in hardware.The time module can maintain various timers for any number of events.

The I/O subsystem 1606 can include a display system such as coupling toan external display, or can include an integrated display such as a flatpanel display, or touch-sensitive display. The display of the I/Osubsystem 1606 displays visual output to the user in a GUI format. Thevisual output can include text, graphics, video, and any combinationthereof. Some or all of the visual output can correspond touser-interface objects. The display can use LED (light emitting diode),LCD (liquid crystal display) technology, or LPD (light emitting polymerdisplay) technology, although other display technologies can be used inother embodiments.

In some embodiments, the I/O subsystem 1606 can include a display anduser input devices such as a keyboard, mouse, and/or trackpad. In someembodiments, the I/O subsystem 1606 can include a touch-sensitivedisplay. A touch-sensitive display can also accept input from the userbased on haptic and/or tactile contact. In some embodiments, atouch-sensitive display forms a touch-sensitive surface that acceptsuser input. The touch-sensitive display/surface (along with anyassociated modules and/or sets of instructions in the medium 1602)detects contact (and any movement or release of the contact) on thetouch-sensitive display and converts the detected contact intointeraction with user-interface objects, such as one or more soft keys,that are displayed on the touch screen when the contact occurs. In someembodiments, a point of contact between the touch-sensitive display andthe user corresponds to one or more digits of the user. The user canmake contact with the touch-sensitive display using any suitable objector appendage, such as a stylus, pen, finger, and so forth. Atouch-sensitive display surface can detect contact and any movement orrelease thereof using any suitable touch sensitivity technologies,including capacitive, resistive, infrared, and surface acoustic wavetechnologies, as well as other proximity sensor arrays or other elementsfor determining one or more points of contact with the touch-sensitivedisplay.

Further, the I/O subsystem can be coupled to one or more other physicalcontrol devices (not shown), such as pushbuttons, keys, switches, rockerbuttons, dials, slider switches, sticks, LEDs, etc., for controlling orperforming various functions, such as power control, speaker volumecontrol, ring tone loudness, keyboard input, scrolling, hold, menu,screen lock, clearing and ending communications and the like. In someembodiments, in addition to the touch screen, the computer device 1600can include a touchpad for activating or deactivating particularfunctions. In some embodiments, the touchpad is a touch-sensitive areaof the device that, unlike the touch screen, does not display visualoutput. The touchpad can be a touch-sensitive surface that is separatefrom the touch-sensitive display or can be an extension of thetouch-sensitive surface formed by the touch-sensitive display.

In some embodiments, some or all of the operations described herein canbe performed using an application executing on the user's mobile device.Circuits, logic modules, processors, and/or other components may beconfigured to perform various operations described herein. Those skilledin the art will appreciate that, depending on implementation, suchconfiguration can be accomplished through design, setup,interconnection, and/or programming of the particular components andthat, again depending on implementation, a configured component might ormight not be reconfigurable for a different operation. For example, aprogrammable processor can be configured by providing suitableexecutable code; a dedicated logic circuit can be configured by suitablyconnecting logic gates and other circuit elements; and so on.

Computer programs incorporating various features of the presentinvention may be encoded on various computer readable storage media;suitable media include magnetic disk or tape, optical storage media suchas compact disk (CD) or DVD (digital versatile disk), flash memory, andthe like. Computer readable storage media encoded with the program codemay be packaged with a compatible device or provided separately fromother devices. Any such computer readable medium may reside on or withina single computer product (e.g. a hard drive, a CD, or an entirecomputer system), and may be present on or within different computerproducts within a system or network. A computer system may include amonitor, printer, or other suitable display for providing any of theresults mentioned herein to a user. In addition program code may beencoded and transmitted via wired optical, and/or wireless networksconforming to a variety of protocols, including the Internet, therebyallowing distribution, e.g., via Internet download.

Although the invention has been described with respect to specificembodiments, it will be appreciated that the invention is intended tocover all modifications and equivalents within the scope of thefollowing claims.

What is claimed is:
 1. A method of operating an accessory device that isin communication with a companion device over a network connection, themethod comprising: receiving, by the accessory device from the companiondevice, an interface definition, wherein the interface definitioncomprises a display specification defining a display of data on theaccessory device; installing the interface definition received from thecompanion device on the accessory device; detecting a display change tobe displayed at a display of the accessory device; generating a displaymessage at the accessory device for an application that is installed atthe accessory device and that is identified by an applicationidentifier, in response to the detected display change; sending thegenerated display message with the application identifier from anaccessory device daemon to a companion device daemon over the networkconnection, in response to the detected display change; receiving anupdated display message from the companion device daemon at theaccessory device daemon; determining one or more display values from theupdated display message for the application identified by theapplication identifier, wherein the one or more display values are inaccordance with the interface definition that defines a display of oneor more elements on the accessory device; and displaying the one or moredisplay values at the display of the accessory device in accordance withthe interface definition for the accessory device.
 2. The method ofclaim 1, wherein the application identifier corresponds to an identifierof an application at the companion device that can process the displaymessage.
 3. The method of claim 1, wherein the application identifier isutilized by the companion device daemon for directing communication ofthe display message to a corresponding companion device extension thatcan process the display message.
 4. The method of claim 1, whereindetecting the display change comprises detecting a user interaction withthe display of the accessory device.
 5. The method of claim 1, whereindetecting the display change comprises detecting a system notificationfor display at the display of the accessory device.
 6. The method ofclaim 1, wherein generating the display message is performed inaccordance with display parameters specified by a stored framework andthe interface definition.
 7. The method of claim 1, further comprising:producing the updated display message with output of a companionapplication that receives the generated display message and that isinstalled at the companion device, in accordance with a framework storedat the companion device and accessed by the companion application. 8.The method of claim 1, further comprising sending a confirmation messagefrom the accessory device to the companion device upon installation ofan accessory device application and the interface definition at theaccessory device.
 9. The method of claim 1, wherein the accessory deviceis a wearable computer device.
 10. The method of claim 1, furthercomprising: sending an accessory device application package from thecompanion device to the accessory device, the accessory deviceapplication package including programming code that, when executed bythe accessory device, provides an accessory device application and theinterface definition.
 11. The method of claim 1, wherein the companiondevice is a mobile device and the accessory device is a wearable device.12. The method of claim 1, wherein the accessory device and thecompanion device are a same type of device.
 13. The method of claim 1,wherein the one or more elements are artifacts, and wherein an artifactincludes one of a display button, a window, a text box, a background,and wallpaper.
 14. The method of claim 1, wherein the interfacedefinition comprises device framework data for the accessory device. 15.A method of operating a companion device that is in communication withan accessory device over a network connection, the method comprising:sending, by the companion device to the accessory device, an interfacedefinition, wherein the interface definition comprises a displayspecification defining a display of data on the accessory device;receiving a generated display message over the network connection at acompanion device daemon from an accessory device daemon installed at theaccessory device, the generated display message identifying a displaychange to be displayed at a display of the accessory device for anapplication that is installed at the accessory device and that isidentified by an application identifier; producing an updated displaymessage with output of a companion application that receives thegenerated display message and that is installed at the companion device,in accordance with a framework stored at the companion device andaccessed by the companion application, wherein the display messagecomprises one or more display values in accordance with the interfacedefinition that defines a display of one or more elements on theaccessory device; and sending the generated updated display message fromthe companion device daemon to the accessory device daemon over thenetwork connection.
 16. The method of claim 15, wherein the applicationidentifier corresponds to an identifier of an application at thecompanion device that can process the generated display message.
 17. Themethod of claim 15, wherein the application identifier is utilized bythe companion device daemon for directing communication of the displaymessage to a corresponding companion device extension that can processthe display message.
 18. The method of claim 15, wherein the identifieddisplay change is identified in response to detecting a user interactionwith the display of the accessory device.
 19. The method of claim 15,wherein the identified display change is identified in response todetecting a system notification for display at the display of theaccessory device.
 20. The method of claim 15, wherein the generateddisplay message is generated in accordance with display parametersspecified by a stored framework and the interface definition.
 21. Themethod of claim 15, further comprising: producing the updated displaymessage with the output of the companion application that receives thegenerated display message and that is installed at the companion device,in accordance with the framework stored at the companion device andaccessed by the companion application.
 22. The method of claim 15,further comprising sending a confirmation message from the accessorydevice to the companion device upon installation of an accessory deviceapplication and the interface definition at the accessory device. 23.The method of claim 15, wherein the accessory device is a wearablecomputer device.
 24. The method of claim 15, further comprising: sendingan accessory device application package from the companion device to theaccessory device, the accessory device application package includingprogramming code that, when executed by the accessory device, providesan accessory device application and the interface definition.
 25. Themethod of claim 15, wherein the display message includes an accessorydevice application identifier that is utilized by the companion devicedaemon for directing communication of the display message to acorresponding companion device application.
 26. The method of claim 15,further comprising: receiving an update display message from theaccessory device, the update display message comprising a change todisplay values of the display of the accessory device in accordance witha user interaction or system notification at the accessory device, theupdate display message including an accessory device applicationidentifier; generating updated display values for display at the displayof the accessory device, the updated display values comprising displayvalues updated from the display values of the display message by thecompanion application and/or a companion extension at the companiondevice; and sending the update display message that includes the updateddisplay values and the accessory device application identifier to theaccessory device for display.
 27. The method of claim 15, furthercomprising: receiving at the companion device a companion deviceapplication package comprising a companion device application forexecution in support of an accessory device application file, acompanion device extension that determines a companion deviceapplication and the framework stored at the companion device to beutilized in support of the accessory device application file, and anaccessory device application package; and installing the companiondevice application at the companion device.
 28. The method of claim 27,wherein the companion device extension includes programming code that,when executed by the companion device, determines display values fordisplay at the accessory device.
 29. The method of claim 28, wherein thecompanion device extension determines the display values in accordancewith framework data.
 30. The method of claim 27, wherein the companiondevice application further includes the companion device daemon forcommunication between the companion device application and an accessorydevice application.
 31. The method of claim 15, wherein the accessorydevice is a wearable computer device.
 32. A computer product comprisinga non-transitory computer readable medium storing a plurality ofinstructions for controlling a computer system to perform an operationcomprising: sending, by a companion device to an accessory device, aninterface definition, wherein the interface definition comprises adisplay specification defining a display of data on the accessorydevice; receiving a generated display message over a network connectionat a companion device daemon from an accessory device daemon installedat the accessory device, the generated display message identifying adisplay change to be displayed at a display of the accessory device foran application that is installed at the accessory device and that isidentified by an application identifier; producing an updated displaymessage with output of a companion application that receives thegenerated display message and that is installed at the companion device,in accordance with a framework stored at the companion device andaccessed by the companion application, wherein the display messagecomprises one or more display values in accordance with the interfacedefinition that defines a display of one or more elements on theaccessory device; and sending the generated updated display message fromthe companion device daemon to the accessory device daemon over thenetwork connection.
 33. A device comprising: a memory; at least onenetwork interface; and a processor coupled to the memory and the atleast one network interface, wherein the processor performs a methodcomprising: sending, by a companion device to an accessory device, aninterface definition, wherein the interface definition comprises adisplay specification defining a display of data on the accessorydevice; receiving a generated display message over a network connectionat a companion device daemon from an accessory device daemon installedat the accessory device, the generated display message identifying adisplay change to be displayed at a display of the accessory device foran application that is installed at the accessory device and that isidentified by an application identifier; producing an updated displaymessage with output of a companion application that receives thegenerated display message and that is installed at the companion device,in accordance with a framework stored at the companion device andaccessed by the companion application, wherein the display messagecomprises one or more display values in accordance with the interfacedefinition that defines a display of one or more elements on theaccessory device; and sending the generated updated display message fromthe companion device daemon to the accessory device daemon over thenetwork connection.
 34. The device of claim 33, wherein the processorperformed method further comprises: receiving at the companion device acompanion device application package comprising a companion deviceapplication for execution in support of an accessory device applicationfile, a companion device extension that determines a companion deviceapplication and framework stored at the companion device to be utilizedin support of the accessory device application file, and an accessorydevice application package; and installing the companion deviceapplication at the companion device.
 35. An accessory device comprising:a memory; at least one network interface; and a processor coupled to thememory and the at least one network interface, wherein the processorperforms a method comprising: receiving, by the accessory device from acompanion device, an interface definition, wherein the interfacedefinition comprises a display specification defining a display of dataon the accessory device; installing the interface definition on theaccessory device; detecting a display change to be displayed at adisplay of the accessory device; generating a display message at theaccessory device for an application that is installed at the accessorydevice and that is identified by an application identifier, in responseto the detected display change; sending the generated display messagewith the application identifier from an accessory device daemon to acompanion device daemon over a network connection, in response to thedetected display change; receiving an updated display message from thecompanion device daemon at the accessory device daemon; determining oneor more display values from the updated display message for anapplication identified by the application identifier, wherein the one ormore display values are in accordance with the interface definition thatdefines a display of one or more elements on the accessory device; anddisplaying the one or more display values at the display of theaccessory device in accordance with the interface definition for theaccessory device.
 36. A computer product comprising a non-transitorycomputer readable medium storing a plurality of instructions forcontrolling a computer system to perform an operation comprising:receiving, by an accessory device from a companion device, an interfacedefinition, wherein the interface definition comprises a displayspecification defining a display of data on the accessory device;installing the interface definition on the accessory device; detecting adisplay change to be displayed at a display of the accessory device;generating a display message at the accessory device for an applicationthat is installed at the accessory device and that is identified by anapplication identifier, in response to the detected display change;sending the generated display message with the application identifierfrom an accessory device daemon to a companion device daemon over anetwork connection, in response to the detected display change;receiving an updated display message from the companion device daemon atthe accessory device daemon; determining one or more display values fromthe updated display message for an application identified by theapplication identifier, wherein the one or more display values are inaccordance with the interface definition that defines a display of oneor more elements on the accessory device; and displaying the one or moredisplay values at the display of the accessory device in accordance withthe interface definition for the accessory device.